Multimedia Integration for Cooking Video Indexing
نویسندگان
چکیده
We have been working on the integration of video with supplementary documents, such as cooking programs. We propose an integration system that performs semantic segmentations of video and text and associates them together. This association is realized using the ordinal restriction of the recipe, cooccurrences of words in the text and the audio in the video, and the relation between the background in a video and words which describe the situation in a text. In this paper, we will introduce the result of an evaluation experiment and show the effectiveness of the proposed integration method. Through our method, many applications should become possible, such as a cooking navigation software.
منابع مشابه
Associating semantically structured cooking videos with their preparation steps
The dramatic growth in the amount of multimedia data in recent years has caused techniques for analyzing those data to become increasingly important. To make use of information contained in multimedia data to the fullest extent, attention has been focused on techniques for processing multiple types of media in an integrated manner. Among the various kinds of videos that exist, the authors selec...
متن کاملShot Clustering Using Background Information
Reflecting the increasing importance of handling multimedia data, many studies are made on indexing to TV broadcast video. Following this trend, we recognize the importance of cooking programs and trying to analyze and index them. In this paper, we propose the shot clustering method using background information, which is one of the most important elemental techniques for indexing to cooking vid...
متن کاملThe Application of Metadata Standards to Video Indexing
This paper first outlines a multi-level video indexing approach based on Dublin Core extensions and the Resource Description Framework (RDF). The advantages and disadvantages of this approach are discussed in the context of the requirements of the proposed MPEG-7 ("Multimedia Content Description Interface") standard. The related work on SMIL (Synchronized Multimedia Integration Language) by the...
متن کاملVideo CooKing: Towards the Synthesis of Multimedia Cooking Recipes
In this paper, we propose the concept of synthesizing a multimedia cooking recipe from a text recipe and a database composed of video clips depicting cooking operations. A multimedia cooking recipe is a cooking recipe where each cooking operation is associated with a corresponding video clip depicting it, aimed to facilitate the understanding of cooking operations. In order to synthesize such a...
متن کاملA Platform for Facilitating Video-based Cooking Communication by MultimediaTechnologies
“Video-based cooking communication” enables people to share the cooking experiences in their home kitchen. Multimedia technologies will facilitate such communication over the Internet. We propose a multimedia processing platform that supports multi-point video communication and provides several functions to easily access raw video and audio. In this system, we can build and test multimedia proc...
متن کامل